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[57] ABSTRACT 

An internetwork relay system and method for transmitting IP 
traffic including an edge and a core. The edge includes an 
ingress and egress routers and the core includes a switch 
network. The ingress router communicates with and receives 
an IP packet from a source network. The ingress router 
attaches to each IP packet, a globally unique label which is 
used to forward the IP packet across the network. The relay 
switch network communicates with the ingress router, 
receives the IP packet from the ingress router and forwards 
the IP packet along its transmission path based on destina- 
tion information included in its attached label. The egress 
router receives the IP packet from the switch network and 
forwards it to a destination network. Once received, the 
destination network forwards the IP packet to its intended 
destination. 

44 Claims, 3 Drawing Sheets 
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INTERNET PROTOCOL RELAY NETWORK 13 for the ATM address corresponding to the IP address of 

FOR DIRECTLY ROUTING DATAGRAM router 11 in the same LIS. In turn, ARP server 13 sends an 

FROM INGRESS ROUTER TO EGRESS address resolution response with information associated 

ROUTER w * tn tne ATM address corresponding to router 11. 

s Thereafter, source 10 builds path-1 across the ATM network 

BACKGROUND OF THE INVENTION to the ATM address of router 11. In turn, router 11 makes a 

determination that the next hop for transmission of the 

1. Field of the Invention packet fe router 14 and f orwar ds the packet to router 14, 

The present invention relates generally to communication across ATM switches 12 and 15, designated as path-2, 

systems and more particularly to an internetwork protocol discovering router 14's ATM address using ARP server 16. 

relay network that allows for the transmission of Internet Similarly, router 14 forwards the packet through ATM 

protocol traffic faster and/or more efficiently than existing switches 15 and 17, designated as path -3 in FIG. 1, to router 

schemes. 17 using ARP server 19. Router 17 in turn makes a deter- 

2. Description of Related Art ruination that it is the last bop router on the path to 
In a data communication network, such as the internet- 15 destination 20. Router 17 sends the packet to destination 20 

work ("Internet"), information in the form of Internet Pro- across A ™ switc h 18 designated as path-4 in FIG. 1 using 

tocol ("IP") datagrams or packets are sent from a source to server 21. 

a destination. These datagrams are sent over the Internet by Although this type of network maintains traditional IP 
way of an "IP backbone" which is a high-speed, high switching on top of an ATM network, it views the underlying 
performance network that links other networks together. The 2 o network as P st another OSI Layer-2 technology, and 
source and destination of a datagram can be, for example, thus does not fully capitalize on the benefits of ATM. In 
the personal computers of two different users. Typically, a addition, the IP routers 11, 14, and 17 and the ATM switches 
datagram, traverses many different routers on its transmis- 12, 15, and 18 run separate protocols to determine the 
sion path from a source to its intended destination. A router address of the next hop making this type of network con- 
is simply a host computer that forwards network traffic from 25 figu^ 011 less efficient. Moreover, each router along the 
one connected network to another regardless of whether or packet's transmission path determines the next hop router 
not the source and destination networks are of the same type. toward its destination. This requires each router to perform 
When a router receives a datagram, it reads the address of Layer-3 processing on the packet to inspect the destination 
the destination host to determine to which router the data- IP address and derive the next hop router from routing tables 
gram should be forwarded. It then replaces the address of the 30 determined by a routing protocol and stored in each router, 
present router with the address of the next router in the Furthermore, this system also includes IP to ATM address 
datagram's address header before forwarding the datagram mapping steps, one in each ARP server, and four ATM 
along its transmission path. This is generally known as switched virtual path (SVC) establishment steps along the 
"Layer 3" processing which refers to the network layer of path between the source host 10 and destination host 20, 
either the Open Systems Interconnection (OSI) seven-layer 35 thereby adding more processing steps to the routing scheme, 
model or to the Transmission Control Protocol/Internet A number of additional network protocol software 
Protocol (TCP/IP) model. This router-to-router "hop", also schemes have attempted to speed-up and increase the effi- 
known as a "hop by hop" process, continues until the ciency of Internet transmissions. These systems can gener- 
datagram reaches the router to which its destination is ally be classified into two groups; the systems in the first 
connected and the datagram is successfully delivered. The 40 group attempt to reduce the amount of Layer-3 processing at 
path of an IP datagram across the Internet traverses many intermediate routers; and the systems in the second group 
routers until it reaches its destination, each of these routers attempt to reduce or eliminate the number of router hops in 
performing Layer-3 processing on the datagram. This pro- a datagram's path. A brief overview of the types of systems 
cessing scheme is generally referred to as the "Classical IF' in each group follows. 

system or model . A disadvantage associated with this system 45 A network processing scheme, known as the "Classical IP 

is that the hop-by-hop transmission process and the associ- Model-Cut Through Routing", attempts to completely elimi- 

3 ted Layer-3 processing at each router contributes to sig- nate router hops however this system is only available in 

nificant and unpredictable delays in the transmission of IP situations where there is a large IP data flow from one 

packets across a network. particular end point to another. This type of processing 

Another network protocol system known as "Classical IP 50 system is schematically shown in FIG. 2. In this system for 

Over ATM" is the most commonly known processing model example, source host 30 determines the ATM address cor- 

to support IP traffic over ATM (Asynchronous Transfer responding to the IP address of destination host 40 and 

Mode) networks and was recently defined by the IETF establishes a cut- through path, or a virtual circuit from the 

(Internet Engineering Task Force). FIG. 1 illustrates a sche- source host 30 to the destination host 40 thereby avoiding 

matic view of this type of network. By way of example, 55 routers 41, 42 and 43. Thus, the cut- through path for a 

source host 10 wishes to send a packet to destination host 20 datagram is defined from source host 30 through ATM 

which is outside the local IP subnet ("LIS") of the source switch 31 through ATM switch 32 through ATM switch 33 

host 10. First, the source host 10 sends the packet to router to destination host 40. 

11 across ATM switch 12 designated in FIG. 1 as path-1. In order to establish the cut-through path from source 30 

Establishment of path-1 over the ATM network is accom- 60 to destination 40, the source 30 must have acquired the 

plished by source host 10 translating the IP address of router address for destination 40 by sending a packet via the 

11 to an ATM address in order to build a virtual path to router Classical Hop-by-Hop Network. Presently, IETF is studying 

11. The Classical IP Over ATM model provides ARP a new address resolution protocol called Next Hop Routing 

(Address Resolution Protocol) server 13 which performs an Protocol (NHRP) which allows IP to ATM address mapping 

IP to ATM address translation for all registered hosts and 65 across LISs so that cut-through paths across ATM networks 

routers within a logical IP Subnet (LIS). In this example, can be established. In the NHRP model, Next Hop Servers 

source 10 sends an address resolution request to ARP server (NHS) 34, 35, and 36 are employed per LIS, or per multiple 
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USs, similar to the ARP servers in the Classical Hop -By- 
Hop network. The key difference between an ARP server 
and an NHS is that an ARP server only communicates to its 
clients in a US, but an NHS may communicate with its own 
hosts as well as its neighbor NHSs supporting other LISs. 

In this configuration source host 30 connected to ATM 
switch 31 becomes an NHRP client when it registers its 
IP-ATM address with its specified NHS 34, similar to the 
ARP server in the classical Hop-by-Hop network. NHS 34 
can be stored in Router 41 or in ATM switch 31. When an 
NHRP client, such as source host 30, desires to switch its 
data traffic from the default (hop-by-hop) routed path to a 
cut-through path, it must first acquire the address of desti- 
nation host 40 by way of a request/response process. This 
process begins by source host 30 sending an NHRP request 
to NHS 34 stored in router 41 via path-la to obtain the 
mapping of the IP address of destination 40 to its corre- 
sponding ATM address. NHS 34 receives the request and 
either has the address mapping in its database because 
destination 40 is in the same LIS, or because it learned the 
address mapping from a previous address resolution request/ 
response process and cached the address of destination host 
40. However, if NHS 34 does not have the address of 
destination 40, it must forward the NHRP request to NHS 35 
stored in router 42 via path-2a. This process continues to 
NHS 36 stored in router 43 via path-3a which is the last NHS 
on the transmission path to the destination 40 via path-4a. 
The NHRP response which carries the ATM address of 
destination 40 follows the reverse path back to source 30 and 
gets forwarded to source host 30 by NHS 34. Thereafter, 
source host 30 builds a virtual path to the destination without 
going through routers 41, 42 and 43 along the transmission 
path between source 30 and destination 40. Thus, to estab- 
lish the address mapping for a cut-through path between 
source 30 and destination 40, a request/response process 
using Layer-3 processing at each router, substantially similar 
to the hop -by-hop process, must be performed at least once. 

Although the NHRP process, once established, avoids 
router hopping and the associated Layer-3 packet 
processing, there are only a limited number of cut-through 
virtual circuits that can be established over an ATM switch- 
ing network. This disadvantage is known as Virtual Circuit 
Explosion which occurs when the number of simultaneous 
virtual circuits through an ATM switching network becomes 
unmanageably large due to IP traffic. Moreover, because the 
typical datagram is relatively small, this request/response 
process needed to establish the path between source 30 and 
destination 40 usually satisfies the transmission require- 
ments between a source and destination for that particular 
communication sequence making a cut-through path 
between them no longer necessary. Moreover, NHRP has 
applicability only to ATM networks and is more suited for 
large data transmissions rather than the standard IP packet 
size. 

Another software routing scheme known as IP Navigator 
combines Wide Area Network (WAN) switching and IP 
routing to store the end destination switch, the switch which 
communicates with an egress router, for each IP packet sent 
over the network. In this manner, switches within the 
network function as IP routers. Once the end destination 
switch is determined, the IP packet is forwarded through a 
pre-established "multipoint-to-point tunnel" to that switch. 
Multipoint- to-point tunneling is a method by which once a 
virtual circuit or cut-through is established, the address 
information is broadcast to all other nodes in the network. 
Once at the end destination switch, a routing table lookup is 
performed to determine the proper egress port of the end 
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switch to forward the IP packet. Similar to the cut-through 
routing scheme, this software model has applicability only 
to ATM networks and suffers from the Virtual Circuit 
Explosion problem. 

The Classical IP with Cut-Through Routing and the IP 
Navigator schemes attempt to reduce, or sometimes elimi- 
nate the number of router hops for the transmission of an IP 
packet across a network. However, Layer-3 processing 
remains a substantia] part of these networks. Thus, a need 
exists to reduce the number of router hops along a data- 
gram's transmission path while also reducing the amount of 
Layer-3 processing at each hop. 

Tag-switching and IP-switching are examples of two 
network schemes that attempt to reduce the amount of 
Layer-3 processing at intermediate routers. However, each 
of these network systems do not reduce the number of router 
hops in the path of an IP datagram. Tag-switching is an IETF 
proposal that inserts a so called "tag" or a shim layer 
between the Layer-2 (Data Link Layer) and the Layer-3 
(Network Layer) of the OSI model. If the data link layer is 
20 ATM, tag switching proposes to use some portion of the 
Virtual Path Identifier (VPI) and Virtual Circuit Identifier 
(VCI) of the 53 byte ATM cell header as the tag. Each IP 
router between the source and destination inspects the 
inserted tag and makes a determination, based on local 
look-up tables, which port to forward the IP datagram. Each 
router establishes a table entry in its database indicating that 
for a particular tag, the datagram originates from a first 
router and should be forwarded onto a particular port to a 
second router. In addition, the first router performs a call 
setup function where the first router informs the second 
router on the path, by a "tag distribution protocol," that the 
incoming IP traffic to be forwarded to the second router has 
a particular tag identifier. This process continues with each 
router inspecting the tag, determining which downstream 
router to forward the datagram to, replacing the existing tag 
with another tag that denotes the address of the next down- 
stream router, and forwarding the datagram accordingly 
until it reaches its destination. Again if the data link layer is 
ATM, each router inspects the VPI/VCI value at the packet's 
header to make a forwarding decision. The tag switching 
involves swapping VPI/VCI values between incoming and 
outgoing ports of each router on an IP packet's transmission 
path. Although Tag-switching illustrates a network that 
attempts to reduce the amount of Layer-3 processing on an 
IP datagram, the number of router hops on a transmission 
path remains unchanged. 

Another system known as IF-swiicliiijg, used uiily in 
ATM networks, also attempts to limit the amount of Layer-3 
processing performed on an IP packet during transmission. 
The general concept of IP-switching is similar to Tag- 
switching, however IP -switching does not use the ATM 
signaling and call set-up process used in Tag-switching. The 
ATM switches are used simply to relay the IP datagrams in 
53 octet chunks with a short tag attached to each packet 
which includes various VPI/VCI values, the use of which are 
determined locally by each router. Both Tag and 
IP-switching schemes reduce the amount of processing on 
each IP datagram by manipulating the tags, however the 
number of router hops is not reduced. Although in both IP 
and Tag-switching each intermediate hop is a router, the 
router does not make the appropriate layer-3 header modi- 
fications such as incrementing the hop count and changing 
the originator's IP address. Furthermore, even though the 
Layer-3 processing is eliminated in some if not all the 
routers, the tag swapping still requires each router to parse 
the header of the IP packet to identify the lag and to write on 
the packet header to swap the tag. 
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As an alternative to the above referenced models, a ("IPRR") 110-115 and IP Relay Switches ("IPRS") 

variant of IP switching can be used in conjunction with 120-123. IPRR's 110-115 form the "edge" of the network 

NHRP. Such a system has been proposed by the inventors of and IPRS J s 120-123 form the "core" of the network pro- 

the present application in their copending U.S. patent appli- vidill g connectivity among the IPRR's. LAN's 100-105 
cation Ser. No. 08/728,276 entitled "Internet NCP-Over 5 represent groups of users typically located within close 

ATM" filed on Oct. 8, 1996 incorporated herein by reference proximity to one another and connected together to form a 

now U S Pat No 5 828 866 network. Although FIG. 3 illustrates a particular configura- 

None of the above described systems both reduces the tioD ° f th f e ^ M V ™V ^° M rk , 
number of router hops an IP packet experiences as it nU f e , r ° f . ^ IP Networks/I^Ns it* 

traverses a network while also reducing the amount of 10 understood that the size of the network is not hmited by the 

t nm ™„,' n „ in a i-i it a ♦ a number of components nor by the interconnection between 

Layer-3 processing in each hop. As many more routers and ^ ese com onen ts 
Web servers are being deployed, a high-speed Internet ^ . ' _ 

backbone is needed more than ever to allow network growth "J ff FIG * 3 > ^ s 10 °- 105 communicate with 

and to improve data transmission performance. IPRR f U0115 ' respectively. However, a particular LAN 

35 may also communicate with one or more IPRR's depending 
SUMMARY OF INVENTION on me network configuration. Each IPRR 110-115 is a 

multihomed host that receives IP packets addressed to itself 

The present invention meets the needs and avoids the or if an IP packel is addressed to another host, each IPRR 
disadvantages and drawbacks of the above described net- forwards the packet to another router via one or more IPRS's 
work schemes and processes by providing an internetwork 2Q 120-123 within the relay network. Each IPRR 110-115 
relay system and method for transmitting IP traffic that performs Layer-3 processing on each IP packet received, 
reduces the number of router hops an IP packet makes ^^.3 processing generally refers to the parsing-out and 
during transmission over the network and also reduces the reading of the IP address included in the header portion of 
amount of Layer-3 processing performed on each IP packet eacn IP packet ^ information contained in this address 
as it traverses the network. 2$ header includes the source IP address and the destination IP 

In one embodiment of the present invention, a relay address. Each IPRR 110-115 examines the destination 
network includes an ingress router which communicates address and compares it to its own network IP address. If the 
with and receives an IP packet from a source network. The destination and source addresses are on the same LAN, then 
ingress router attaches a globally unique label to each IP the IP packet is routed directly to the host with that desti- 
packet. The label is used to forward the IP packet across the 30 nation address. If the destination address is not attached to 
network. A relay switch network communicates with and the same LAN, one of the IPRR's 110-115 which commu- 
receives the IP packet from the ingress router based on nicates with the LAN forwards the IP packet to a particular 
information included in the label. The switch network for- IPRS 120-123 based on information contained in a routing 
wards the IP packet along its transmission path based on table the details of which will be described in more detail 
destination information included in its attached label. An 3S below. 

egress router receives the IP packet from the switch network The IPRR that receives the IP packet from a LAN for 
and forwards it to a destination network. Once received, the transmission over the network is known as the "ingress" 
destination network forwards the IP packet to its intended iprr. Based on the information contained in the address 
destination. header of a particular IP packet, the ingress IPRR attaches, 

In another embodiment of the present invention, a relay 40 at the network layer (Layer-3), a fixed length header referred 
network includes an ingress router which communicates to as a "label". This label will be read by one or more IPRS's 
with and receives an Internet protocol datagram form a 120-125 as the IP packet is forwarded over the network 
source network. The ingress router attaches to the datagram toward its destination. When an IPRS receives an IP packet 
a label that includes information corresponding to the data- from the ingress IPRR, its function is to forward the packet 
gram's intended destination. The datagram is forwarded to a 45 towards a destination or "egress" IPRR that communicates 
switch network from the ingress router. The switch forwards with a LAN connected to the destination host. The IPRS may 
the datagram to an egress router such that the egress router forward the IP packet to another IPRS en the transmission 
is one router hop away from the ingress router. path or to an egress router depending on the packet's 

intended destination. An IPRR can be physically connected 
BRIEF DESCRIPTION OF THE DRAWINGS 50 t0 more than one IPRS. In this case the last IPRS in the 

FIG. 1 is a block diagram of a classical IP over ATM transmission path of an IP packet is the one that lies on the 
network optimal path to the egress IPRR as determined by the routing 

FIG. 2 is a block diagram of an IP network with cut a ^" l ^ m " , t . , T „ . m „„ 

throueh routine attached to each IP packet by an ingress IPRR 

' . 55 has significance in that certain portions of the label identify 

FIG. 3 is a schematic view of a Relay Network in certain components or grmips of components of the Relay 

accordance with the present invention m which a plurality of Network ^ c fa similar lQ a {&[ hon£ number ifl 

routers define the edge of the Network and a plurality of lhat a tfarec m ^ codc dcsignates in what part of thc 

switches define the Network s core. coumry a phone fe , ocated> the lhree digit exchange iDdicates 

FIG. 4 illustrates the processing flow of an IP datagram as 60 a rcg ion within the area code, and the last four numbers 

it traverses the Relay Network shown in FIG. 3. specify a particular line within the exchange. Unlike existing 

DETAILED DESCRIPTION network protocol systems where packet routing information 

may comprise random identifiers, the label in the present 

Referring first to FIG. 3, the principles of the present Relay Network possesses information corresponding to 

invention are illustrated in this simplified functional view of 65 where within the Network a destination is located. For 

an IP Relay Network interconnecting Local Area Networks example, the first part of the label may indicate which IPRS 

("LAN") or IP Networks 100-105, IP Relay Routers or group of IPRS's within the network the IP packet is 
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intended. AEOther portion of the label may indicate which based on extensions to standard IP routing protocols such as 

port on the IPRS the packet should be sent to, or in other OSPF (Open Shortest Path First). IPRRs 110-115 and IPRSs 

words, which egress IPRR. 120-123 participate in a common routing and topology 

Each IPRS is a data link or Layer-2 device in that it reads exchange protocol which not only distributes the usual IP 
the label attached to each IP packet and determines the next 5 routing and link state topology information, but also distrib- 
stop, either another IPRS or an egress router, for the IP utes the IPRS ID and PORT ID or alternatively the IPRR ID 
packet along its transmission path. Once the IP packet is information for the entire network depending on which label 
received by an egress router, the label is removed and the IP version is employed. This protocol allows each IPRR 
packet is forwarded to its destination. Unlike Tag and 110-115 to construct its routing and forwarding tables which 
IP-switching schemes, an IPRS in accordance with the 10 are stQred in a memory device? or in different me m 0 ry 
present invention does not modify or swap the label attached devices within each IPRR. 
to an IP packet as the packet is forwarded along its trans- 
mission path. Accordingly, the forwarding operation of the For a given destination IP address, the routing table stored 
IPRS's is amenable to high speed hardware implementations in each IPRR 110-115 provides the label to be attached to 
thereby achieving large forwarding rates and through-puts 15 the IP datagram. The routing table contains identification 
required by Internet and Intranet applications. information corresponding to an egress IPRR for addressing 

The above general overview is best understood by way of each IP packet as opposed to only the next hop router 

the following example which is used for illustrative pur- address used in other network systems. The routing table 

poses and is not intended to limit the scope and spirit of the stored in each IPRR 110-115 has the general structure 

invention. A source host 90, such as a personal computer, 20 illustrated in Table 1 . 
connected to LAN 100 sends an IP packet to destination host 

95, also a personal computer, connected to LAN 103. The IP TABLE 1 

packet is transmitted from host 90 through LAN 100 to 

IPRR 110 in a conventional manner. IPRR 110, considered IP 10 ^ IPRR m $ RS ,D ' 

the ingress IPRR, reads the address header in the IP packet 25 



and determines that the destination host is not attached to a 

LAN to which IPRR 110 can deliver the packet directly. Referring to Table 1, the Destination IP Address is obtained 

IPRR 110 performs Layer-3 processing on the IP packet, as fr 0m reading the header address portion of an IP packet. The 

well as attaching a label to the IP packet based on informa- FLOW ID, as described above, is assigned locally by the 

tion included in a routing table stored in a memory device in egress IPRR based on policies defined by the network 

IPRR 110 indicating that the next hop router is IPRR 113, administra tor. The LAST IPRR ID identifies the egress 

considered the egress IPRR. In this manner, ingress IPRR IpRR tQ whjch ^ dcstination host commimicatcs via a 

110 views egress IPRR 113 as being only one hop away. ^ ^ ^ {IpRS ^ pQRT m} ^ an ^ fie[d 

The IP packet is forwarded to IPRS 120 which may be, for 35 where ^ last IPRS id refers to the IPRS that commu- 

example an ATM switch This forwarding process is per- nicates with thc IpRR and the pQRT , D ^ {Q ^ 

termed by mapping tfte address information stored m 1FKK . • j ^ ^ IpRR 

is connected to via the last 

110 s routing table with address information stored in a ; B no ™ a- *u • * tL , u i i ^ iL 

forwarding table also stored in IPRR 110. IPRS 120 reads IPR , S ' D ^ ndin g on the "° f D the ^Umployed the 

the label and forwards the IP packet to IPRS 122 based on , n ™ tlDg * ble st ° rcd » each IPRR maps the desunation 

information stored in a forwarding table at IPRS 120 cor- 40 * dd ™ s V^f*" W P acket t0 either t _ lhe ^ 

responding to egress IPRR 113. IPRS 122 also reads the ( ^ AST IPRR ID ) or t0 the ffRS and P h y sical P ort that 

label and forwards the IP packet to egress IPRR 113 based communicates with the egress IPRR (LAST IPRS ID, PORT 

on information stored in its forwarding table corresponding ID )- B y including the identification of the egress router in 

to egress IPRR 113. Egress IPRR 113 receives the IP packet, 45 these routing tables, each IPRR has a complete knowledge 

performs Layer-3 processing to reassemble the packet, and of the routed network. As additional IPRRs are added to the 

forwards it through LAN 103 to destination host 95. relay network, the routing tables in each IPRR are dynami- 

The IP Relay Network in accordance with the present cai] y u P date d through the use of a routing algorithm. The 

invention can accommodate several different label formats routing table stored within each IPRR contains the egress 

attached to an IP packet by an ingress IPRR. In one version 50 IPRR to en route to eacn La y er 3 destination as opposed to 

of the label, identification information corresponding to the the next hop router. 

egress IPRR (IPRR ID) is used. Alternatively, the label may Additionally, a default IPRR can also be implemented in 

include identification information corresponding to the last the Relay Network in accordance with the present invention 

IPRS (IPRS ID) that communicates with the egress IPRR by designating one of the IPRRs 110-115 as the default 

and the IPRS port (PORT ID) on which the egress IPRR 5S IPRR. If the IP Relay Network is connected to a non-IP 

communicates. In addition, a FLOW ID may also be network, then the default IPRR will be considered the egress 

included in the label to differentiate between multiple IP IPRR for traffic destined for such non-IP networks. The 

packets bound for the same destination. This allows IPRSs default IPRR performs the necessary Layer 3 processing on 

along the IP packet's transmission path to provide different the IP traffic and forwards it to the first router of the non-IP 

quality of service treatment to different IP packets. For 60 Relay Network. For example, if a packet is sent from IP 

example, the FLOW ID can denote that a confirmation network 105 to non-IP network 155, IPRR 115 is considered 

message indicating that the packet has been received needs the default IPRR and performs the necessary Layer 3 

to be sent back to the source. In addition, the FLOW ID may processing on the packet. The packet is then forwarded to 

be used for routing IP packet traffic across multiple least- non-IP Router 150 which in turn forwards it to its destination 

cost paths in the relay network. 65 in non-IP network 155. 

The manner by which IPRRs 110-115 learn about what The forwarding table stored in each IPRR 110-115 has the 

labels to attach to an IP packet for a given egress IPRR is general structure shown in Table 2. 
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TABLE 2 



EGRESS IPRR ID LAST IPRS ID PORTID(l) PORT ID (2) 

5 

Referring to Table 2, the EGRESS IPRR ID identifies the 
egress IPRR to which the IP packet is forwarded. The LAST 
IPRS ID refers to the IPRS that is physically connected to 
the egress IPRR. The PORT ID fields have local significance 
depending on the particular IPRR and the destination of the 10 
IP Packet. The PORT ID(1) and PORT ID(2) fields refer to 
the port from the ingress IPRR onto which the IP packet is 
sent. In other words, the PORT ID (1) and PORT ID (2) 
fields indicate which IPRS the IP packet is forwarded to 
from the ingress IPRR, Two different PORT ID's, namely 15 
PORT ID(1) and PORT ID(2) can be used since there may 
be several alternate (least-cost) paths to an IP packet's 
destination. For example, the forwarding table in IPRR 110 
may have a PORT ID(1) corresponding to IPRS 120 and a 
PORT ID (2) corresponding to IPRS 121. If the egress IPRR 20 
is IPRR 112, then ingress IPRR 110 can forward the packet 
to either IPRS 120 or IPRS 121 depending on the IP traffic 
currently being sent over the network which impacts the 
least-cost path to egress IPRR 112 for that particular IP 
packet. The IPRR may choose among these alternate ports 25 
available to route the IP packet to the egress IPRR based on 
its local algorithm. 

Each IPRS 120-123 stores a forwarding table in memory, 
each of which has substantially the same structure as that 
shown in Table 2 above. The PORT ID (PORT ID (1) and 30 
PORT ID (2)) refers to the port on which the ingress IPRR 
should en route the IP datagram to the egress IPRR via the 
IPRS communicating with the egress IPRR. Similar to the 
different paths available to an ingress IPRR, PORT ID(1) 
and PORT ID (2) indicate alternative, least -cost paths to the 35 
next IPRS in an IP packet's transmission path. When an 
IPRS receives an IP packet, the IPRS reads the IPRS ID 
portion of the label and maps it to the LAST IPRS ID entry 
in its forwarding table to determine the outgoing PORT ID 
of the IPRS which is connected to either the next IPRS along 40 
the transmission path or to an egress IPRR depending on the 
packet's destination. Accordingly, the PORT ID field has 
local significance in that it denotes the port of an IPRS on 
which an IP packet is routed to the next IPRS or to an egress 
IPRR. Moreover, if PORT ID (2) is selected and load 45 
balancing is enabled, then the FLOW ID field is hashed to 
select the particular outgoing port on an IPRS. The FLOW 
ID field may also be used, for example, to differentiate 
between IP traffic requiring a secure path across the network 
denoted as FLOW ID (1) and a packet having a less secure 50 
path across the network denoted as FLOW ID (2). The use 
of a routing table in each IPRS avoids the need for any 
Layer-3 processing on an IP packet. 

The forwarding table in each IPRS and IPRR are also 
dynamically updated based on the topology or link-state of 55 
the network. Thus, when the topology of the network 
changes by the addition or subtraction of IPRRs and/or 
IPRSs, the optimal paths across the core network may 
change and the forwarding tables change accordingly. 

FIG. 5 illustrates the software processing flow of an IP 60 
datagram as it traverses an IP Relay Network in accordance 
with the present invention. The process begins in step 200 
when one of the IPRRs 110-115, considered the ingress 
IPRR, receives an IP datagram from one of the end stations 
connected to a LAN or IP network 100-105. In step 201, the 65 
ingress IPRR parses the IP datagram and reads the IP address 
of the destination connected to a particular LAN 100-105. 



The IP address is contained in the header portion of the IP 
datagram. In branch 205, the ingress IPRR checks to deter- 
mine if there is a routing table entry corresponding to the 
destination IP address for the IP packet received. If the result 
is YES, step 207 is performed and the ingress IPRR retrieves 
the routing table entry to determine the "label" to be attached 
to the IP packet. However, if the result in step 205 is NO, 
indicating that there is no routing table entry in the egress 
IPRR for the destination address, then the egress IPRR uses 
the table entry corresponding to the default router as the 
egress IPRR as shown in step 209 and the process proceeds 
to step 207 described above. In step 208, IPRR-100 attaches 
the label to the IP datagram using Layer-3 processing. In 
conditional branch point 211, IPRR-100 checks to determine 
if there is a forwarding table entry in its database for the 
LAST IPRR ID. If the test result is YES, it checks to 
determine if it is the last hop to the destination station in 
conditional branch point 271. If the test result is YES, then 
the IPRR removes the label and forwards the IP datagram to 
its final destination in step 291. The process exists in step 
250. 

If the test in step 271 is NO, indicating that the receiving 
entity is not the last IPRR, then it sends the IP datagram to 
its port identified by the PORT ID retrieved from the 
forwarding table in step 221. If the test result in step 211 is 
NO, indicating that there is no forwarding table entry for the 
egress IPRR, then the process exists in step 250. 

In step 251, an IPRS 120-123 which receives the packet 
from the ingress IPRR determines if any forwarding entry 
exists in the forwarding table stored in its memory. If a 
forwarding table entry does exist then the IP datagram is 
forwarded to the next IPRS on its way to the egress IPRR. 
The process returns to step 211, where each IPRS on the 
transmission path determines if there is a forwarding table 
entry for the next IPRS. This process is reiterated for each 
IPRS along the path until the datagram is delivered. 

What is claimed is: 

1. An internetwork relay system for transmission of 
internet protocol traffic along a transmission path in a 
network from a source to a destination, said system com- 
prising: 

an ingress router communicating with said source and 
receiving said datagram from said source; 

a globally unique label identifying said destination used to 
forward said datagram across said network, said label 
attached to said datagram at said ingress router; 

a relay switch network communicating with said ingress 
router and receiving said datagram therefrom based on 
information included in said label, said switch network 
forwarding said datagram along said transmission path 
based on information included in said label; and 

an egress router receiving said datagram from said relay 
switch network and forwarding said datagram to said 
destination based on information included in said label. 

2. The internetwork relay system of claim 1 wherein said 
relay switch network includes a plurality of relay switches, 
said switch network forwarding said datagram from said 
ingress router to said egress router such that said egress 
router is one router hop away from said ingress router. 

3. The internetwork relay system of claim 2 wherein said 
label attached to said datagram is processed as read-only by 
each of said switches. 

4. The internetwork relay system of claim 2 wherein each 
of said switches includes a forwarding table stored in a 
memory device, said forwarding table including routing 
information corresponding to said destination of said 
datagram, each of said switches reading said label, matching 
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said destination information included in said label with said 
routing information contained in said forwarding table and 
forwarding said datagram along said transmission path 
toward said egress router based on said routing information. 

5. The internetwork relay system of claim 1 wherein said 
ingress router includes a routing table stored in a memory 
containing said destination information and identification 
information corresponding to said egress router. 

6. The internetwork relay system of claim 2 wherein one 
of said switches within said relay switch relay network 
communicating with said egress router along said datagram 
transmission path is an egress switch, said ingress router 
including a routing table stored in a memory device con- 
taining identification information corresponding to said 
egress switch. 

7. The internetwork relay system of claim 6 wherein said 
routing table further includes identification information cor- 
responding to a port on said egress switch through which 
said egress router communicates. 

8. The internetwork relay system of claim 2 wherein said 
ingress router includes a forwarding table stored in a 
memory device containing identification information corre- 
sponding to said egress router. 

9. The internetwork relay system of claim 2 wherein said 
ingress router includes a forwarding table stored in a 
memory device containing identification information corre- 
sponding to a port on said egress switch that communicates 
with said egress router. 

10. The internetwork relay system of claim 2 wherein said 
ingress router includes a forwarding table stored in a 
memory device containing identification information corre- 
sponding to said egress switch. 

11. The internetwork relay system of claim 5 wherein said 
routing table is updated dynamically upon the addition of a 
relay switch to said internetwork relay system. 

12. The internetwork relay system of claims 6 wherein 
said routing table is updated dynamically upon the addition 
of a relay switch to said internetwork relay system. 

13. The internetwork relay system of claim 6 wherein said 
routing table is updated dynamically upon the addition of a 
relay switch to said internetwork relay system. 

14. The internetwork relay system of claim 5 wherein said 
routing table is updated dynamically upon the addition of an 
egress router to said internetwork relay system. 

15. The internetwork relay system of claim 6 wherein said 
routing table is updated dynamically upon the addition of an 
egress router to said internetwork relay system. 

16. The internetwork relay system of claim 7 wherein said 
routing table is updated dynamically upon the addition of an 
egress router to said internetwork relay system. 

17. The internetwork relay system of claim 6 wherein said 
label includes identification information corresponding to 
said egress router. 

18. The internetwork relay system of claim 6 wherein said 
label includes identification information corresponding to 
said egress switch and identification information corre- 
sponding to a particular port on said egress switch commu- 
nicating with said egress router. 

19. The internetwork relay system of claim 18 wherein 
said label further includes flow identification information for 
differentiating between multiple datagrams routed to the 
same destination. 

20. The internetwork relay system of claim 18 wherein 
said label further includes flow identification information for 
balancing datagram traffic across multiple transmission 
paths. 

21. The internetwork relay system of claim 1 wherein said 
switching network includes an asynchronous transfer mode 
switch. 



►6,021 

12 

22. The internetwork relay system of claim 1 wherein said 
ingress router attaches said label to said datagram using 
network layer processing. 

23. The internetwork relay system of claim 1 wherein said 
S egress router removes said label from said datagram using 

network layer processing. 

24. The internetwork relay system of claim 1 wherein said 
label is partitioned to include information related to the 
location of said destination. 

3Q 25. A method for transmitting Internet Protocol (IP) 
packets across a relay network, said packets originating from 
a source and forwarded to a destination, said method com- 
prising the steps of: 

receiving said IP packet from said source; 
35 forwarding said IP packet from said source to an ingress 
router based on address information included in said IP 
packet; 

parsing out said IP packet at said ingress router in order 
to read the address of said destination; 
20 appending a unique label to said IP packet at said ingress 
router, said label including identification information 
related to the address of said destination; 
forwarding said IP packet from said ingress router to a 
switching network; and 
25 forwarding said IP packet from said switching network to 
an egress router such that said ingress router is one 
router hop away from said egress router. 
26. The method of claim 25 further comprising the step of 
removing said label from said IP packet at said egress router 
30 27. The method of claim 26 further comprising the step of 
reassembling said IP packet at said egress router. 

28. The method of claim 25 further comprising the step of 
forwarding said IP packet from said egress router to said 
destination. 

35 29. The method of claim 25 wherein said ingress router 
includes a routing table stored in a memory device, said 
routing table including address information corresponding 
to said egress router. 

30. The method of claim 25 wherein said ingress router 
40 includes a routing table stored in a memory device, said 

routing table including address information for said switch- 
ing network corresponding to said destination address. 

31. The method of claim 30 wherein said routing table 
further includes identification information associated with a 

45 port of said switch network communicating with said egress 
router. 

32. The method of claim 29 further comprising the step of 
including in said label, address information corresponding to 
said egress router, said address information contained in said 

50 routing table. 

33. The method of claim 25 wherein said ingress router 
includes a forwarding table stored in a memory device, said 
forwarding table including address information related to 
said information corresponding to said destination address, 

55 said method further comprising the step of mapping said 
destination address to said address information correspond- 
ing to said egress router. 

34. The method of claim 29 wherein said switch network 
includes a plurality of relay switches, each of said switches 

60 including a forwarding table, said table including informa- 
tion corresponding to said egress router. 

35. The method of claim 34 wherein said forwarding table 
includes port identification information corresponding to a 
port in said switches communicating with said egress router. 

65 36. The method of claim 29 further comprising the step of 
updating said routing table dynamically each time a router is 
added to said network. 
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37. The method of claim 30 further comprising the step of 
updating said routing table dynamically each time a router is 
added to said network. 

38. The method of claim 33 further comprising the step of 
updating said forwarding table dynamically each time a 
router is added to the network. 

39. The method of claim 34 further comprising the step of 
updating said forwarding table dynamically each time a 
switch is added to said network. 

40. An internetwork relay system for transmission of 
internet protocol traffic along a transmission path, said 
system including a source network and a destination 
network, said system comprising: 

an ingress router communicating with said source net- 
work and receiving an internet protocol packet from 
said source network; 

a label attached to said packet at said ingress router, said 
label including information corresponding to said des- 
tination network; 

a switch network communicating with said ingress router 
and receiving said packet therefrom, said switch net- 
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20 
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work forwarding said packet based on destination 
information included in said label; 
an egress router receiving said packet from said switch 
network such that said egress router is one router hop 
away from said ingress router, said egress router for- 
warding said packet to said destination network. 

41. The system of claim 40 wherein said switch network 
includes a plurality of relay switches, each of said switches 
including a forwarding table, said table including informa- 
tion related to one or more of said plurality of switches 
located on said transmission path. 

42. The system of claim 40 wherein each of said forward- 
ing tables include information corresponding to said desti- 
nation network. 

43. The system of claim 42 wherein said label uniquely 
identifies said destination. 

44. The system of claim 43 wherein said label is viewed 
by said switch network as read only. 
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